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ABSTRACT ^ 

With the use of verbal report strategies, a study was 
conducted to examine (1) the types of comprehension strategies 
readers use to process familiar and less familiar texts and (2) the 
differential use of think aloud strategies by average and below 
average readers. Subjects were 15 tenth grade male students in 
upstate New York. Two weeks prior to testing, students were given a 
50-item ^completion test assessing their knowledge of American 
football and rugby union. After two practice sessions were completed, 
subjects were told to begin reading the test passage on football and 
rugby and to stop when they came to a pause signal. At this point, 
they were asked to briefly summarize what they had read so far and to 
state what they were thinking or doing as they read to comprehend 
that portion of text. They were also asked specific probe questions 
t^ identify the use of problem solving strategies. Findings indicated 
th^t the more knowledge subjects had about a topic, the more they 
evaluated what they were reading^ drew inferences, and made direct 
comparisons between familiar and less familiar passages. Students 
with\below average comprehension ability evidenced a greater number 
of errors in recalling the content of the passages, made fewer 
evaluative comments, and drew fewer inferences while reading less 
familiar passages than their average classmates. (A copy of one text 
passage is appended. ) (HOD) 
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Verbal Reports: How Readers Process Unccjuiliar Text: 



Tiitrod uctiioii 

During the past several years researchers have examined the effects of prior 
knowledge on the comprehension of text (e.g. Broim, Sailey, Day, To^/nsend & Lawton, 
1977; Marr & Gonaley, 1982; Pearson, Hansen & Gordon, 1979; Taylor ,"1979) . These 
sttidieis demonstrated that individuals access prior knowledge and experiences to 

interpret text, and farther, that this knowledge influences the amount and. type of ' 

. _ / 

infornation extracted^ Researciiers harve also found that, by- providing studaats. x^ith 

information about, arr. uaf aiaili-ax' topic (cricket) and/or by dra"?^g comparisons- between 

/ 

familiar and tm Frm^ 7 -r ^ topics (cricket and baseball), understanding and leami^g^.of 
the ,'new inf onrtatiott was- increased (Hayes & Tieraey,' 1982). All of these stiidiea lend 
support to theories of the comprehension process which, suggest that a higher order 
ccnceptual framework. (Schfiaaa)is used to interpret and comprehend text*. 

Concurrently, researchers have become increasingly interested in the strategies 
readers use to comprehend text. In an effort to examine the processing strategies 
readers utilize while reading, Olshavsky (1976-1977) introduced the use of think— 
aloud tasks o She patterned her study after the v/ork of Newell and Sinon (197z) on 
problem solving strategies « Olshavsky found that good readers apply the problein-; 
solving strategies mors frequently than poor readers and that both interest in the 
topic to be read and abstract ^/riting style increase the use'of problem-solving 
strategies during the comprehension process. Although the use of verbal reports as an 
index. of cognitive processing has received a great deal of criticism historically 
aiid quite recently (see Gamer, 1982, for a discussion of these issues), Ericsson, 
and Simon (1930) argna quite convincingly that on-] ine verbal reports which minimize 
the interval between processing and reporting provide a viable data-^ase of co.fjnitive 
processes used to solve problems or comprehend what is read. As a riesult, readina 
research has begtm to reflect this methodology* Gamer (1582)^ asked students to 
read and suzxiarize an. expository text. She founu that there were a greater number 
of "cognitive events" or strategies reported in the same day treatment group as 
compared with the delay treatment group. She posits that the thoroughness of a 
verbal report seems to depend to some extent on the recency of the activity.^ lending 
support to the position taken by Ericsson and. Simon. Following a similar methodology. 
Hare and Scaith (1982} asked students to read expos 'tory and narrative selections, 
pause at various points in the passage and think-^aloud describing their comprehension 
strategies. They found when achievement test scores were correlated v-lth response 
types, the total uniqne number of strategies elicited fron the ejrposxtory passage 
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was negatively correlated v;tth reading achievenent: aaJ uaralated to thoi'e respoases 
elicited f roa the narrative passage« Rereading and imaging vere frequently ^tited 
strategies when reading the narrative paGsagejand rereading and changing speeds frequentl 
cited for the expository passageo 

Based on these EQye recent studies which utilized the verbal report strategy, 
it was felt that the think-aloud task nay provide viable* information regarrixng the 
processjLng of familiar and less faniliar text. Thus, the purpose of the present 
study was to extend the exiiSxiig rtssaarch exa^iini^g prior knowledge and reading > 
comprehension to inclrjirip a verbal report strategy which might . provide new inf onnatibxt 
regarding: 1) the types of coraprefaension strategies reader's use to process familiar 
and less familiar texrs and 2) differential use o£ these think-aloud strategies .lay 
average and below average readers » 

Method 

' Subjects , , 

Fifteen male tenth--grade sfddents from a High School in upstate Nev York were 
selected for partricipation in the studyc Nine students had above average comprehension 
skills and si:c belov average comprehension skills^ Reading Ability was determined 
by their performance on the California Achicvenar.t Tes t (1977) « Teacher jud^ent ^ 
was used to cohfim this, reading ability piaceinent. At the outset of the study, 
t?E;enty subjects participated, however, due to difficulties x^dth the taping equipment 
protocols from f ive-^ o5 the subjects were inaudible ^nd thus not usedc^ 

Materials . 

Two passages adapted from the Webster's Sports Dictionrir v (1976) were constructed 
eath containing approxiicately 327 v/ords, similar sentence structures, and an 
equivalent "number of idea units (Kintsch, 1974)* After the passages were constructed 

the Daie-Chall (1948) readability formula was employed to derive a readability estimate 

and Dg! i^rees of Reading Power (DRP) 'estimate for the two passages. Each passage 
corresponded to a 7~:^ readability indeuc and 55 DRP units, commesurate with the 
students^ placement: on the DRP test (1980), The passages were erxpository in nature 
and described the sports of American, football and rugby union (see the appendi'rc). 

r ... * " 

Procedure ' ^ 

Prior Knpr/ledge Pretest s Two weeks prior to testing students were given a 50 item 
conrpletion test assessing their knowledge of American football and rugby union. The 
test assessed four levels of knowledge concerning the goal structure of each ganra* 



Tha'.^^ icvel« were derived, frcn tli^^. \:ork u'c SpLlLch, Vesoadar, C:\ic3x aad Va3s (1979) 
v;hLch has iihown that the typd oE kaow Ledge a pcct-:ori has about a topic will InQucince 
his/her ability to recall info rraz^^t ion, ip.tegrate and ela*;orata upon ideas presented 
in the text. Thus, it v;as felt the type of prior t^iowL^dga Che subjects have about ' 
a parcicalar topic might influence the d^-pe oE problem-solving strategy used in the 
cccipreheasion of the passagesa Hence, tha pretest assfissed knov/ledge o£ : Level //I ~ 
the object of the gane; Level irl - scoring points; Level h3 - advancing plii^yers (to 
score); and Level ^-4 - gama actions which facilitate level #3, for both sports. 

Test items consisted of terninology, rules of Che ''fiaaa and 
situations of play each, correapoudin^ to the four le:vels of knowledge above. 

Trainihg Session ^ Iimediately prior to tasting students were given a practice 
session to' familiar iza then with the think-aloud task. Two practice passages were 
constructed; gidap^ted from the V7ebster^s Sports Dictionary^ they were structurally 
equivalent to the test passages and described thi=^ sports of soccer and cricket* In 
this manner, the practice and test passages were similar x>rith regard to te:::t 
structure and varying degrees of familiarity. FormaL testing began wh^a the subjects 
completed the t^^o practice passages, were 'talking freely, and expressed a readiness 
to begin formal testing. • " 

0 

Testing o Subjects were, tested individually o They were told to be.gin reading the 
test passage silently and to stop when they came to a red dot, ^a pause signal to 
think-aloudo At this signal they v;ere asked to: 1). briefly surmarize what they had 
read so far -and 2) state what they were thinking or doing as they read to comprehend 
that portion of the texto Subjects v;ere asked to continue reading and thinking aloud 
at each of the pause points until the passage was finished. Each passage contained 
12 pausal points placed at the end cf each topic in the passage (e.g. object of the 
game, scoring a touchdown, defensive players^ c'tc. ) Each subject read both passages 
in one oE two orders (Eootball-rugby, or vice versa). In this manner, response 
patterns which might surface could not be attributed to a fixed order of reading 
the passages r ^ 

After the two test passages were read, specific probe questions were asked to 
identify the use of problem-solving strategies which may have been used, but were 
not reported previously. Testing time was approximately 45 minutes for each student. 

Scoring. Subjects verbalizations were tape recorded and transcribed. These 
transcriptions were then matched with the text and responses classified into categories 
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developed by Olshavsky (1976-1977) and Hare and Smith (1982) • New catogoriGs 
were created as needed to interpret the tr -^criptlonsc Subjects' responses fell 
into three general categories based on the testing task. The flri,t: category was 
labeled summary responses; these were the responses students gave vhan asked to; 
briefly summarize what they had read thus far- The second category was labeled 
metacognitive responses; these ixicluded responses which reflected the students use 
of specific strategies to comprehend the text, make comparisons, identify a pexsonal 
experience similar to the information in the text, image, etco The th^rd category 
was labeled probe metacogaj,tive responses, - This catagoi/ included the responses 
students gave when asked questions about their use o a particular comprehension 
strategy such als rereading, imaging, predicting meaning etCc Response categories 
are listed in the appendix. There were 24 opportunities to report one or more of 
these strategies (12 pausal units per passage) the raw number cjf responses was 
tallied for each subject and used in the data analysis. * 

Design and Analysis ^ 
. 

The design for the study was 2 (reading ability) x 2 (passage) factorial. 
T-tests were used to make comparisons .be tv/een the two reader groups with regard to 
prior knowledge of -.the sports and response types. Step-wise regression analyses 
were also used to determine the influence of levels of prior knowledge on the type 
of response elicited from the passage. ' . 

INSULTS 

Reader Group Differences 

T-test comparisons were made between the two reader groups with regard to 
the total number of summary and metacognitive responses elicited from the passages. 
These tests revealed no significant differences between the two reader groups ^ Good 
readers reported an average of 4.90 summary responses (s.d. = 3-10) to the poor 
reader group's average of 2.83 (s.d. = 2.93). Metacognitive responses averaged , 
7.40 .(s.d. = 2.68) for the good readers and 5.17 (s.d. 4.83) for the poor readers. 
When responses within each of the two categories were examined, T-test comparisons . 
Were non-significant, however, patterns of differences were beginning to emerge. 
Reader groups differed with regard to the error statements elicited from the 

H " -^P " ^r^^ rugt^y passages, Xg := .89, Xp = 3,43, They also 

differed in terms of the number of evaluative statements about football, Xg = 1.00, 
Xp = .17 and the number of inferences elicited from the rubgy passage, Xg = 1.89, Xp== 
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One possible explanation for the lack of significant differences between these two 
reader groups is that the sample size is limited (N- 15). ^ 

Passage Differences . 

A second series of comparisons were made examining the prior knowledge scores 
and responses across the football and rugby passages. As expected, the students 
knew more about the sport football (X= 14. 4A) than rugby (X=4p54), t(28) ~ 5c09, 
p< pOOl. There were also more total me tacognitive statements elicited from the 
rugby passage (Xr =9,93 versus Xf = 6^53), t(28) = -2o09, p< .05a This finding 
was not surprising when one cortsiders that a person is u-^ually much more aware of 
the comnrehension str;^tec^ies thpy are using when the material is difficult or' 
unfamiliar. Likewise , it is difficult to monitor comprehension strat:egles when 
much of the processing is occurring at a below-conscious level vhile rp.ading 

familiar material (Cavanaugh, & Perlriutter , 1982). Another difference between he 
two passages surf aced when the students were reading the rugby passage. A greater 
number of comparisons (rugby to football) were" noted (X = 3,20) than were present 
when the football passage was read (X = ^67), t(28) ^ -2.94, p ^1 .05^ This pattern 
of ^ re.<^po"se provides evidence that one attempts to understand the loss familiar or 
new through comparisons with a kno\m topic. A pattern consistent with the current 
theories of the comprehension process. 

Prior Knowledge 

Of major ^interest was the extent to which prior knowledge of the topics would 
influence the type of think-aloud strategy elicited from the passages. To examine 
the Influence of this variable, a series of step-wise regression analyses were 

cnndncted. The results from this analysis are reported in 'Tables 1 and 2. At the 

, ' - - - _ - 'J ■ 

outset of the study there were four levels of knowledge which comprised the total 
-ptior knowledge score. A series of regression analyses revealed that these individual 
levels of knowledge did not serve as significant predictors of ihe response types « 
Thus, these knowledge levels were collapsed to form a total prior knowledge score 
for eaph sport and used in subsequent regression analyses. 

insert Table 1 , 
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An examination of Table 1 reveals that students^ knowledge oE football was 
a significant oredictor n£ thei-r ab^ll^•y to make evaluative statements about the 
football passage, F(l,7) = 21.26, p/cOl, accounting for 47.79% of the total 
variance'. #This findingr suggests that prior knowledgric of a topic is a critical 
variable if the students are going to evaluate v;hat is read rather than merely 
assimilate the information and try to retain it in memory. Prior knowledge of 
. football also' served as a significant predictor of the studentsV ability to infer 
infomation from the rugby passage-, F(l,7) = 17.29, p<.01, accounting for 61.7A% of 
the total variance. Thus it appears as though students' ability to interpret a ^' 
less familiar topic beyond a literal level depends in large part on their knowledge 
of a similar topic and "their ability to establish the/similarities between the two 
topics. Lastly, looking at Table 2, prior knolwedge of football sqrved as a strong 
predictor of the- students ' reported use of a comparison strategy to facilitate the 
processing cf the tuo passages, F(l,10.) = 6.12, p c05, accounting for 3Q.43% of the 
total varianceo 

V * insert Table 2 - 

Of particular interest xi/as the finding that knowledge of rugby did not serve 
as a significant predictor of either summary or metacognitive responses elicited 
from the rugby passages „ This lack of signiExcance may be due in part to the 
students* limited knowledge of rugby as evidenced by their pretest scores. 

DISCUSSION AND CONCLUSION 

The verbal report methodology appears to be a useful technique to examine the 
processing strategies readers use to comprehend familiar and less familiar text. Whil 
the results from tKis study are preliminary in nature due to the limited sample size> 
these findings lend support to current schema- theoretic views of the comprehension 
process. 

Readers did use prior knowledge to comprehend the passages. In particular, the 
more knowledge a subject had about a topic the more inclined he betame to evaluate 
what he was reading, draw inferences . between ideas of less .familiar content, and make 
direct comparisons between familiar and less f Miliar passages. In addiuion students 
with below average comprehension ability evidenced a greater number of errors in 
recalling the content of the passages, made fewer evaluative statements about the 
familiar content, and drew fewer inferences while comprehending the less familiar 
O passage than their average classmates. \ 
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These latter findings lend support to the notion that in addition to the Importance 
'o^ prior knowledge"" in comprehension, readers need to be taught specific strategies for 
yomprehending text (Collins & Smith, 1^0), strategies which proficient readers seem 
/to acquire almost intuitively. Readers in this below average group appeared easily' 
frustrated when they encountered comprehension difficulties, and perhaps most important, 
they appeared unaware of strategies such as rereading and imaging which could be used 
to facilitate comprehension. 

In addition to these ijreliminary findings, this study also raises several concerns. ; 
To what extent were students cued to report only certain types of processing strategies 
in the think aloud training tasks (Cavanaugh &• Ferlmutter , 1982) . "How might the 
training task's less obtrusive yet assist the subject in gaining access to cognitive 
processes which carj be verbalized. Also,, how does one quantify response types. In 
this study, therre w^re 24 opportunities for both nummary and metacognitive responses to 
be elicited'. By the nature of the response types (e.g. draw inference, state failure 
to understand a clause) not all responses would be reported at each pausal point 
- throughtout the passage. Perhaps the optimal scoring strategy would be to predict 
the likely occurrance of each of these responses at each point and weight the 
occurrance Accordingly. Thus, transformed scores rather than raw scores could be used 
in the data analysis. Lastly, might the results from undirected probe questions 
prove to be more representative of the student's cognitive processing than directed 
probe questions which ask if a particular type of strategy was used to 

comprehend the passages. Perhaps the undirected probe question (e.g. Can you think 
back to any strategies you may have used?) might more aptly reflects the student's 
"true" cognitive strategy, although retrospective, rather than their perception of 
what they ought to report.' 

Subsequent i^esearch is presently being planned to address some of the concerns 
expressed above and to examine in^ detail the relationship between levels of prior 
knwoledge and specific response types. . 
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TESr TASSAGF. 

Fcot±all is a gc-in-e playai beb..ci^in b,<o tea.T3 of 11 players each. It is playcfcl 
on a iargG rectangular field Mitii goal posts at each end. kJ^ The object o^.tlie 



. gaIra_ls_Jtg_.rlan^pass7--e3^^ Llie^ball across the opponent's goal line for a score 
Play is started by one team kicking ths, ball to tha oth^. Subsequent play 
is started from the line of scrirorage, th^ point at which tiia ballcarrier \>jas 
tackled. ^ Ev^ tloiigh.tfca game is calTed football^ kicking plays a minor 
role odier than in attsnpting a field goal or point after a touchdcm* Play 
is rot continuous. It stops whenever the ballcarrier is tackled, v;han a pass is 
inccnrplete, or after a score is ^nade. -i^^ Each side is given four chances or 

,dcn;vns to advance the ball for a gain of 10 yards. If they are unable to make 
that gain, the ball is given to the other side. -^P^ Defensive players iray 

tackle the ballcarrier and^ra^ stnve playeirs out of the way to get to him. 

.--^ 

Offensive players arel^pSittiai to block their opponents, but iray not use their 
hiands to keep players av;ay fran the ballcainrier or the passer. Any offensive ' 
player iray run with the ball, but only the ends and backs are eligible to catch 
a fort/ard pass. Although tackling, slio^/ing and blocking are normally • 

perndtted, unusually rough play and illegal use of hands are foilLs usually 
penalized by a loss of 5, 10, or 15 yards. 

vrnen a team carries or passes the ball over the goal line, it scores a 
touchidc.-Tn wo.rth 5 points and has an opportunity to kick the ball over the crocsbar*' 
or canr/ it over the goal line for extra points. A field goal, a kick over 

the crossbar other th3n aftear a tDUch±X'7n, is wortii 3 points. The garr:^ is . 

pla'^^ in four 15 minute quarters • The teain ^d.th the highest score at the end of 
the playing tiire: \7ins. 
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